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We study the phase synchronization of Kuramoto's oscillators in small parts of networks known 
as motifs. We first report on the system dynamics for the case of a scale-free network and show the 
existence of a non-trivial critical point. We compute the probability that network motifs synchronize, 
and find that the fitness for synchronization correlates well with motif's interconnectedness and 
| structural complexity. Possible implications for present debates about network evolution in biological 

, and other systems are discussed. 
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(NJ ; I. INTRODUCTION 

During the last years, many scientists have scrutinized the world around us looking for regularities. One of the most 
O recent findings is the fact that many real systems can be cast into a common topological structure, called complex 
networks pj. Examples include biological 013 social Q and technological p| systems that exhibit similar patterns of 
interconnections pj . They are characterized by the existence of key elements in the network which drastically reduce 
the average distance between all of them, the so-called small- world property . Additionally, it turns out that for 
a large number of real- world systems, the probability that any given element (node) of the system interacts with (is 
linked to) k other components, follows a power-law P(k) ~ fc -7 , with and exponent 7 usually estimated between 2 
\ and 3. These networks have been termed scale-free (SF) networks. 

The above property was soon shown to be at the root of distinct behaviours when several dynamical processes 
are placed on top of SF networks. These are the cases of percolation and epidemic spreading processes, intensively 
* 1 studied duringthe last years due to their practical relevance in different applications and the availability of analytical 
treatments 0, H, la OH UH • The peculiar topological properties of the underlying network for these two processes lead 
to the absence of any percolation or spreading threshold in the thermodynamic limit, a previously well-established 
' result for regular and random graphs. 

It is then natural to ask whether or not and to what extent the topology of complex networks influences the 
behaviour of other dynamical processes. In particular, for biological and other applications, it would be relevant to 
consider the nodes of a given network as nonlinear dynamical systems. The behaviour of an isolated generic dynamical 
t^- system in the long-term limit can be described by stable fixed points, limit cycles or chaotic attractors [l2^ . However, 
' we have learned in recent years that when many of such dynamical systems are coupled together, the details matter. 
In this way, the study of networks with both dynamical and structural complexity might shed light on a number of 
relevant open problems where nonlinearity and spatial complexity coexist. Dynamical complexity may manifest itself 
through self-organization, synchronization, the emergence of order, etc. 

In this paper, we study the emergence of collective phase synchronization in scale-free networks and in simple 
topological configurations such as triangles, squares and pentagons with a variable number of internal connections, 
called network motifs. To this end, we study the model proposed by Kuramoto several years ago and show how a 
large number of the system's constituents forms a common dynamical pattern, despite the intrinsic differences in 
their individual dynamics. On a theoretical level, we point out that the fitness for synchronization of network motifs 
correlates well with their conservation in the evolution of protein motifs 14], which might hint at new connections 
Ch , between graph theory, dynamics on networks and biological systems. 
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II. THE KURAMOTO MODEL IN SCALE-FREE NETWORKS 



In order to study how topology influences collective dynamics, we assume that each network's component is an 
oscillator and that each interacts with the others following the Kuramoto model [Tol ITi| . This choice is due to 
the remarkable prestige achieved by synchronization as a cooperative phenomenon within nonlinear science and to 
the seniority, elegance and universality of this model. Specifically, each node i is considered to be a planar rotor 
characterized by an angular phase, Oi , and a natural frequency uii. Linked nodes interact with a coupling strength A 
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FIG. 1: Phase diagram of the Kuramoto model in random scale-free networks for several average connectivity values (k) — 2m. 
The onset of synchronization occurs at a nonzero value of A in all cases. Although not shown, the transition follows the 
mean-field behaviour exhibited by the globally coupled map. Each value of r is the result of at least 10 network realizations 
and 1000 iterations for TV = 10 4 nodes. 



according to 

^ = u}i + \J2sm(e j -e i ) (i) 
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where fcj is the number of neighbors of the rotor i as given by the actual architecture of the underlying graph. For 
the present work, the natural frequencies and the initial values of 9i have been randomly drawn from a uniform 
distribution g(cj) with mean luq — in the interval (—1/2,1/2) and (— 7T, tt), respectively. Synchronization occurs 
when A exceeds a critical value, at which clusters of frequency-locked oscillators appear. This state represents the 
emergence of cooperation between network's constituents. 

The original Kuramoto model corresponds to the simplest case of globally coupled (all-to-all), equally weighted 
oscillators where the coupling strength A = K/N to ensure that the model is well behaved in the thermodynamic 
limit flH Il6[ . For this model and without any interaction, K = 0, the oscillators follow their own dynamics as 
determined by their natural frequencies and thus the system is unable to synchronize. However, as K increases the 
population of rotors becomes more coherent and few oscillators form a small cluster of ordered (synchronized) states. 
If K is further increased, the synchronized pack tends to recruit more and more oscillators and eventually the system 
settles into a unique and totally synchronous state. The onset of synchronization occurs at a critical value of the 
coupling strength, K c = 2/irg(u;o). The second-order phase transition is characterized by the order parameter 
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which behaves when both N — » oo and t — > oo as r ~ (A" - K c f for K >K C being (3 = 1/2. 

In order to study the d yna mics of the model on top of complex heterogeneous networks, we first generated SF nets 
using the BA procedure |17| . In this model, starting from a set of mo nodes, one preferentially attaches each time 
step a newly introduced node to m older ones. The procedure is repeated N — mo times and a network made up 
of N nodes with a power law degree distribution P(k) ~ fc -7 with 7 = 3 and average connectivity (k) = 2m builds 
up. This network is a clear example of a highly heterogenous network in that the degree distribution has unbounded 
fluctuations when N — > oo. 

We have performed extensive simulations of the model |l8j | through numerical integration of the equations of motion 
Eq. QJ. In the case of random SF networks the global dynamics of the system is qualitatively the same as for the 
original Kuramoto model. The phase diagram of the system is shown in Fig. ^ for a network of N = 10 4 nodes and 
several values of the average connectivity (k) = 2m, where r is the order parameter as given by Eq. Starting from 
small values of the coupling strength, the interactions do not overcome the tendency of each rotor to oscillate according 
to its individual dynamics. In this state, the behaviour of the system is completely incoherent and no synchronization 



is achieved. This picture persists until a certain critical value A c is crossed. At this point some elements lock their 
phase and a cluster of synchronized nodes comes up. This constitutes the onset of synchronization. Beyond this 
value, there are several groups or clusters within which the nodes are either synchronized and locked in phase or still 
governed by their intrinsic dynamics and thus in an asynchronous state. The first groups add to r and it departs from 
zero as A is increased beyond A c . Finally, after further increasing the value of A, more and more nodes cluster around 
the mean phase and the system eventually settles into a completely synchronized state where r« 1. 

On the other hand, Fig.^also provides evidence that the critical point at which synchronization is attained in these 
SF networks is not zero [18( . This is more clearly appreciated if one eliminates the dependency observed in the figure 
of the parameter r on the average connectivity of the network (k). If in Eq. the term A is substituted by A/(fc), 
the (fc)-dependency is avoided and all curves in Fig. ^ collapse into a single one, showing a critical coupling strength 
A c = 0.25(3) signaling that even for large values of the average connectivity, A c is not equal to zero. Additionally, 
finite-size scaling analysis 01 shows that the transition remains of the second-order type as for the case of fully 
connected networks. 



III. SYNCHRONIZATION OF NETWORK MOTIFS 



Let's now turn our attention to small geometrical structures known as motifs 0, |2£j, EI instead of looking at 
the whole network. These structures can be defined as graph components which are observed in a given network 
more frequently than in a completely random graph with identical P{k). Triangles and rectangular loops are among 
these graph components, also known as cycles. They are important because they express the degree of redundancy 
and multiplicity of paths among nodes in the topology of the network and reveal the existence of hierarchical levels. 
Hence, the extension of the study of synchronization phenomena to motifs is also relevant. 

We have computed for all motifs up to N — 4 nodes the probability, P syn c, that synchronization occurs. This 
probability is an increasing function of A, and is calculated for each A by randomly drawing the values of the natural 
frequencies u>i from a uniform distribution in the interval (—1/2, 1/2). Starting from A = 0, one averages, for every A, 
over many realizations of u>i and computes the relative number of simulations where synchronization is accomplished, 
Psync- We define A*, which varies from motif to motif, as the value of A beyond which P sync > h- The lower A* is for 
a motif, the better it synchronizes. In Fig. [21 we have represented P sync as a function of A for several motifs. 

The simplest case of the dimer (#1 in the Table) can be deduced analytically. Using the same notation as in Eq. 
JU, here we have: 



-± = wi + A sin {9 2 - ft), = lu 2 + A sin (9 1 - 6 2 ). (3) 



To solve these equations, we introduce the new variables, 



2A 

/ = 2 - 01, K = U>2-U! 1 , C = . (4) 

K 

Thus, / is the phase difference between the rotors, n is the difference in the natural frequencies and c is a dimcn- 
sionless constant equal to twice the ratio X/k. From Eq. J2J we obtain, 



h df ■ » =dt. (5) 
k[1 — c sin/) 

The integration of Eq. 10 leads to three solutions depending on the value of c. The three distinct results of the 
integral in Eq. (0) indicate a different functional behaviour of the system when c < 1, c = 1, and when c > 1. In 
fact, c = 1 is the critical point. In consequence, from the definition of c in Eq. the critical coupling of this system 
corresponds to 



A* = - = (u; 2 - Wl )/2. (6) 

Recalling that the ws are drawn from a uniform probability distribution in the interval (—1/2, 1/2) with a mean 
equal to zero, i.e., w\ = —uj 2 = cj, we have that the synchronization condition reduces to A > u>. The probability 
Psync is then equal to P syn c = yh = 2A, for A < 5, and P syn c — 1 for A > 5. Thus, for the dimer we have A* = 4. For 




FIG. 2: Probability of synchronization for five topological motifs. Configurations are according to Table|T] Each value of P sy 
is the result of 1000 iterations over the distribution of Wj for each value of A. The horizontal line marks the threshold of P sy . 
for the computation of A*. See the text for further details. 



the other motifs, P sync has been calculated numerically by means of a 4 -order Runge-Kutta method. The results 
are summarized in Fig. for several motifs (see also Table [i] below). 

From Fig. [21 one realizes that for a fixed motif's size, the way in which connections are established determines the 
synchronization threshold of that motif configuration. For instance, configurations 4, 6, and 9 correspond to motifs 
made up of four oscillators with a variable number of connections among them. However, their A* are quite different. 
This indicates that the details of the local and internal connections matter. In particular, we observe that the higher 
the interconnection between motif's constituents, the lower A*. 



IV. DISCUSSIONS AND CONCLUSIONS 



We now show how the present study may provide useful hints to a better understanding of several experimental 
observations in biological systems. Recent advances in network analysis and modeling have provided a promising ap- 
proach to understanding basic biological organization [13) ^ n ^is context, quantitative evidence has been recently 
reported |l4j that in Saccharomyces cerevisiae, the proteins organized in definite cohesive patterns of interaction, and 
these patterns themselves, are conserved in the evolution across species in a substantially higher degree than those 
that do not participate in such specific motifs. A second finding [l4j is that the conservation of proteins in distinct 
topological motifs correlates with their interconnectedness. 

These observations take place in the context of activities occurring within a living cell and which no doubt, are of 
extreme complexity. Non-linear dynamics prevails at this level of organization, where units that interact according 
to simple rules can generate unexpected complex patterns [T^ . On a theoretical level, one may hypothesize that 
the observed persistence across evolution is due to some mechanism aimed at optimizing the cooperation between 
neighboring nodes. A first approach would then be to see if the same structures favor the synchronization as a 
cooperative phenomenon. 

Table 1 summarizes the results found in and the values of A* for the Kuramoto's model in the same motifs. It is 
surprising the existence of a possible correlation between conservation and fitness for synchronization of network motifs. 
Namely, the lower A*, the higher the natural conservation rate. From Table [IJ one observes that: i) AJ < A2 < A5, 
for the chain- like motifs; n) A5 > Ay > A| > Ag, for motifs ordered in increasing degree of complexity, i.e., when one 
can go from the lower configuration (5) to next one by adding a new link arbitrarily; and Hi) A5 > Ag > A| > Ag, 
when interconnectedness between motif constituents increases. This may indicate that motifs displaying an improved 
fitness to develop cooperative activities are preserved across evolution with a higher probability. 

The results here obtained for topological motifs may be seen on a more general basis concerning the architecture 
of real biological and social networks. It is known that for most of these networks, the probability of finding cycles 
(motifs) in their structure is higher than that expected from a completely random graph with the same connectivity 
distribution. For social and biological networks, friendship or business relationships and natural selection seem to be 
at the origin of such cycles. From this perspective, one may assume that these networks have been shaped during their 
evolution by some kind of optimization mechanism that improves on a local level their ability to develop cooperation. 



# 


Motif 


x" 


NCR (%) 


1 


• • 


0.25 


13.67 


2 




0.28 


4.99 


3 


A. 


0.1 6 


20.51 


4 


I - I 


0.31 


0.73 


5 


I — • 


0.32 


2.64 


6 


T — T 

I — I 


0.20 


6.71 


7 




0.22 


7.67 


g 


±^-I 


0.1 8 


1 8.68 


g 




0.14 





TABLE I: The third column gives the value of the coupling strength beyond which the motif synchronizes with probability 
Psync > 7p Natural conservation rates (NCR) reported in the table are taken from [l4|. The values reported are sorted in such 
a way that for a fixed N, the NCR values are in increasing order. Although not shown due to the lack of NCR values, our 
conclusions hold for five-node and higher motifs. In particular, it is straightforward to conclude from the mean-field description 
of the Kuramoto model (all-to-all architecture) that as N increases, the synchronization threshold decreases. 



If a new link is created and afterwards it reveals as not beneficial, then it is removed at later times. 

In summary, we have studied the synchronization of Kuramoto's phase coupled oscillators for the cases of scale-free 
networks and motifs. The results obtained indicate that the architecture of random SF networks allows synchroniza- 
tion at a small value of the coupling strength A. Additionally, motifs with high interconnectedness show the lower 
synchronization thresholds. Moreover, the results presented here for the Kuramoto's model hold for other non-linear 
dynamical systems, including chaotic oscillators |2J|. Our results then lead to a twofold conclusion. On one hand, 
they suggest that non-linear mechanisms may be key ingredients for the understanding of the evolution of networks 
at a local scale. On the other hand, as recently unraveled f or p rotein and other biological networks, the real topology 
of the systems under analysis is worth taking into account [25j . Finally, we point out that the kind of models studied 
here together with the spatial complexity of the underlying net is relevant for cell biology. A recent example can 
be found in the discovery that an ultradian clock (oscillator) shapes genome expression in the yeast Saccharomyces 
cerevisiae 26]. 
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